Articulatory VCV Synthesis from EMA Data
نویسندگان
چکیده
This paper reports experiments in synthesizing VCV sequences with French unvoiced stop or fricative consonants, using a time-domain simulation of the vocal-tract system. The necessary dynamics of the vocal-tract shape are derived in two steps: first, time-varying parameters of an articulatory model are calculated automatically from electromagnetic articulography (EMA) data, using a method previously published by the first author; second, semi-automatic corrections are applied to properly account for consonantal events. Time-varying characteristics of the glottis are set using empirical rules. Friction noise is generated along the length of the whole vocal-tract instead of locally at the narrowest constriction. Spectrogams of satisfactory synthesis results are presented alongside those of real speech recorded simultaneously with the articulatory data. Corresponding audio files are available online.
منابع مشابه
Patterns of Jaw Coarticulatory Direction and Linguomandibular Coordination in VCV Sequences
Data on lingual movement, dorsopalatal contact and F2 frequency presented in previous papers of ours (Recasens, 2002; Recasens and Pallarès, 2001; Recasens, Pallarès and Fontdevila, 1997) suggest that the degree of articulatory constraint (DAC) model accounts to a large extent for the extent and direction of tongue dorsum coarticulation in VCV and CC sequences. A goal of this investigation is t...
متن کاملResynthesis of 3D tongue movem
Simultaneous measurements of tongue and facial motion, using a combination of electromagnetic articulography (EMA) and optical motion tracking, are analysed to investigate the possibility to resynthesize the subject’s tongue movements with a parametrically controlled 3D model using the facial data only. The recorded material consists of 63 VCV words spoken by one Swedish subject. The tongue mov...
متن کاملReconstruction of mistracked articulatory trajectories
Kinematic articulatory data are important for researches of speech production, articulatory speech synthesis, robust speech recognition, and speech inversion. Electromagnetic Articulograph (EMA) is a widely used instrument for collecting kinematic articulatory data. However, in EMA experiment, one or more coils attached to articulators are possible to be mistracked due to various reasons. To ma...
متن کاملInvestigation of Coarticulation Ba Articulographi
Coarticulation between the speech organs is a natural phenomenon in human speech. To realize this mechanism in our physiological articulatory model [1], this study attempts to analyze coarticulation involved in continuous speech based on electromagnetic articulographic (EMA) data recorded from three Japanese male subjects. The spatial target of each phoneme in CVC and VCV segments out of the se...
متن کاملAn EMA study of VCV coarticulatory direction.
This study addresses three issues that are relevant to coarticulation theory in speech production: whether the degree of articulatory constraint model (DAC model) accounts for patterns of the directionality of tongue dorsum coarticulatory influences; the extent to which those patterns in tongue dorsum coarticulatory direction are similar to those for the tongue tip; and whether speech motor con...
متن کامل